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ABSTRACT . . , 

Psrsons frca th© ti©ld of sci©ncs education and 

persons who had extensive experience working with visually 
handicapped children were brought together ^o establish some 
baselines and beginning ideas of approaches to the evaluation of a 
laboratory - centered science program (Science Curriculum Improvement 
Study) as it is being used with visually handicapped children. Areas 
in which participants were in agreement relative to evaluation in the 
project were: (1) The evaluation approach needs to be individualized 

in all ways and should attempt to assess the changes in specific 
pupils; (2) The evaluation system and approach will have to be 
original since little has been done in the evaluation of the science 
learnings of "blind" children; (3) Evaluation has to be continuing 
and related to the individuals in a given class or program at a given 
time; (4) Children's skill in using tools should be evaluated; (5) 
Considerable emphasis was given to the value of expert observers as a 
means of evaluation or program success; (6) Concern was also 
expressed for finding ways to assess the effect of the program on the 
individual's value system and general orientation towards science as 
indicated by his feelings regarding environmental pollution and other 
major problems in society. This work was prepared under ESEA Title 
III contract. (BE) 
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Introduction 



Evaluation of the learning experiences of young children is 
a difficult task. Especially in science, the verbal limitatio^ of 
the children and their developmental inabHity to handle abstr^tions 
makes extremely difficult the design of meaningful assessment 
procedures. 



All at these difficulties and limitations are significartly inerted 
when one turns the focus of their attention to the •’blind" (see Note) 
child. As a groi«), these children have had fewer real experiences 
and are operationally retarded in language development and tl» 
ability to put thoughts and experiences together. A search of the 
literature revealed little in relation to evaluation of science Iraraings 
for "blind" children; and as a matter of fact, little that related to 
any aspect of a science program for blind elementary school children. 
For these reasons it was decided that it would be valuable early in 
the project (start of the fourth month) to hold a conference to eialua- 
tion plaiming. The reason for the conference as stated in the letter 

of invitation was: 



•The purpose of the conference is to bring together individuals 



Note- For purposes erf this report and the project as a whole, blind 
is taken to mean any child with a visual handicap severe enoi^h to 
warrant special educational placement either in a regular school or a 

Specialized school for the blind. 
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from the field of science education with those who have had extensive 
experience workii^ with visually handicapped children. Hopefully, 
by causing both siroups to interact with the staff of our project, we 
win establish some baselines and also beginning ideas of approaches 
to the- evaluation of a laboratory-centered science program as it 
is being used with visually handicapped children. " 

Fifteen of the sixteen people invited attended the half-day con- 
ference. A list of the participants and their affiliations is included 

at the end of this report. 



Organization of the Conference 

The conference opened with a short description of, and introduc- 
tion to the life and physical science program of the Science Curriculum 
Improvement Study. This was necessary since the work ot ms project 
will be based on tne SCIS units. Next came a presentation of some of 
the early adaptations designed by the project staff and the results of 
the trials of some of these in the classroom. A short videot^ 
id one of the teaching sessions at the California State School for the 
Blind was shown. This introduction of the program served to orient 
the participants to the purposes of the project and its mode of opera- 
tion. The evaluation needs of the project were then briefly discussed 
by the group as a whole. The addendum g-ving the revised statement 
of Project Objectives and Evaluation Plans was distributed to each 
participant. 

The group then broke up into three subgroups so structured that 
ed£h one included a cross section of the: skills and experience possess 
by the individuals at the conference. The groups, each under the 
lerdership of a project staff member, met for about 1-1/2 hoims to 
consider the topic of the conference and try to formulate specific 
evaluation plans. A free interchange of ideas was encouraged and no 
formal presentations were made in any of the subgroup sessions. 

Each subgroup then reported its findings to the group as a whole 
and a discussion was held relative to the findings of the subgroups 
and the further ideas of the conference participants. 
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Outcomes of the Conference 

The major suggestions and ideas resulting from the conference 
are included in the reports of the three subgroups. Each of these 
reports and a summary of the major points brought iq» in the final 
session follow: 

Report of Subgroup 1 

Members of this group were: 

Mr. Carl Berger, Chairman and reporter 
Dr. Phillip HaUen 
Dr. Paul Hurd 
Dr. Everett Wilcox 

The objective of the subcommittee was to develop new approaches 
to the problem of evaluation, particularly the problem of developing 
baselines for evaluation of visually handicapped children. That 
is, develop kinds of measures relative to the capabilities of the 
children that will enable us to know adiere the children are at 
the onset of the program. 

A first single approach suggested was the measure of hand 
skills. Because of the large number of items of science 
materials^ a simple check list on the children's ability to 
manipulate the objects could be easily devised. After a suit- 
able period of time this could be checked again and gains 
could be recorded. 

The sample of legally blind children that will be using the SCIS 
materials will be very small and has tremendous variation; thus 
no attempt should be made to compare groups of children. An 
entirely individual approach should be taken in the emluation 
of blind children. For the first time, this is economically 
feasible because of tho resource teacher available to work with 
blind children. 

Thus we must develop a position paper for evaluation based on the 
individual child. Each part of the evaulation should be based on 
where the child is at entry, then develop some measure to 
determine the success he is having with the materials. Since 
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each child is measured against himself, he would be measured 
on his own scale, not on a group scale. From this position, 
tv/o very ingenious measures emerged: 1) the field trip 
measure; and 2) the description measure. 

The field trip. Video tape children on a field trip and use this 
as baseline. Tape a one -minute session of each student. 

After the program, retape and find what observing cools suf- 
ficiently different the children are using; also if they are using 
concepts from the ciassroom in a context out of the class- 
room. 



The second measure, description. Give each child the same 
object and record his description of the object after asking, 
'"i'ell me about this object”. Then after working with the 
materials, have him describe the object again. Record and 
tally the number of terms used, and types of terms. Find the 
shift in terms from function and similarity to property and 
material. 



Blind children, possibly more than any other, have had limited 
environmental experience. Thus, some may enter the SCK 
program with the knowledge of fewer raises of materials 
than other children. Baseline evaluation can determine the 
readiness for SCIS and, if necessary, be used as guidelines 
to determine an SCIS readiness program. 

Two different baselines should be established; one dealing 
with verbal description and the other, a measure of the non- 
verbal science behavior. Non-verbal ability can be generated 
along the lines of those devised by Larry Kateman and Phil 
Yocum in their work on ’’orientation mobility”. That is the 
ability to follow a set of sequenced directions. In this respect, 
blind children may be ahead of sighted children because tl.ey 
are quite aware of the terms, ’right”, ’’left”, etc. 







We should not concern ourselves with any particular organism if 
microscopic, but achieve tlie same concept through another non- 
microscopic organism. Thus the parallel organism could be 
used in evaluation of the concept as gained by the s^hted chil- 
dr».-n. 



The evaluation should take a quite different track. One approach 
would be a '^success evaluation” approach. In success evalua- 
tion, tlie children’s evaluation can be viewed as feedback and 
optional activities continue until each individual chi’d succeeds. 
Thus, the evaluation of the project would be successful because 
each child will have succeeded. Some children may have taken 
longer than others, but all will have been successful. 

Hawkins at the Elementary Science Center at University of 
Colorado, has done some interesting work on evaluation of deaf 
children and the report would be quite helpful to us. 



Report of Subgroup 2 



Members of this group were: 

Mr. Robert Knott, Chairman and reporter 
Dr. Carson Nolan 
Dr. Don Lundstrom, 

Dr. Robert Karplus 
Mr. Ross Huckins 



After a short discussion of available evaluative instruments for 
severely visually handicapped persons, we decided there were 
no standardized tests we could use to measure the kinds of 
process and content improvements we expect with these children. 
The BLAT (Blind Learning Aptitude Test) is the only test we 
know which may be useful. 



Four classes of people were identified as possible sources for 
our evaluation: 



1 . 

2 . 

3 . 



The classroom teacher and teachers of other subjects. 
The child. 

The parent, counselor or relative with whom the student 
resides. 

The resource teacher. 
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Our concensus was that the evaluation of the child*s development 
in scientific abilities and literacy should include subjective 
measurements made outside the classroom as well as those made 
in the science classroom settii^. 

Some specific skills we would measure include the foUowmg: 

1. The increased use of tactile discrimination to investigate 
new materials. 

a. Measure the speed with which a child uses tactile methods 

to "observe”. . - j.- 

b. Measure the time he spends on tactile discrimination. 

c. Measure the detail threshold he reaches before he quits. 

2. The quality of tactile discriminations. 

a. Measure how well he can duplicate an object by making a 
molding clay copy. 

b. Measure the quality of his description of objects. 

c. Measure the improvement in his ability to handle or 
assemble objects and equipment. 

3. The motor improvement including the increased diversity of 
his manipulations evidenced as he explores new objects. 

4. The child’s improvement in problem recognition. 

5. The child’s willingness to try to solve a problem. 

6. The quality of the child’s attempts to solve problems. 

7. The length of time a child spends on science irrespective of 
demand. 

8. Tool-using ability. 

9. The changes in children’s abilities and willingness to manipu- 
late and change situations so they can isolate the factors 
responsible for the phenomenon. 

10. The child’s ability to study a board with various shaped 
holes at one time; study various shaped blocks at a separate 
time; then to decide which objects go into which hole when 
he works with both the blocks and the board. 

11. The number of attacks a child makes on a problem before 
and after his science course. 

Some measurements of the child’s content achievement are: 

1. Personal questioning by the resource teacher. 

2. Classroom contributions. 

Er|c a. Quantity. 

b. Quality. 
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3. Spontaneous use of words and concepts. 

4. How specific the children are in their descriptions of objects, 
relationships, and phenomena. 

5. Vocabulary development. 

6. Identification of system parts impressed on pages as those 
from the system with which they have been working. 

Some measurements of the child’s relationships with others are. 

1. The charge in acceptance of the blind child by sighted chil- 
dren duriig science as compared to non-science courses. 

2. The changes in self-esteem evidenced by the blind child 
pre and post science course. 

Some general comments. 

1. Keep the evaluation simple 

2. Utilize video tapes and a panel of judges. 

3. Use college students to collect data. 

4. Teachers should be trained (by resource teachers) how to 
evaluate children’s use of their hands. 



Report of Subgroup 3 

Members of this group were: 

Dr. Herbert Thier, Chairman 
Dr. Berthold Lowenfeld, Reporter 
Dr. Lawrence Lowery 
Mr. David Passarell 
Mr. Fred Sinclair 

The group’s assignment was described as the consideration of 
what should be included in the design of an evaluation program for 
the project. Tliat is, how does one measure or assess changes 
in children who have had the program. 

A number of important guidelines were suggested by members 
of the group, and these are listed below: 

1. Evaluate performance of the individual child in carrying out 

er|c 



the program activities.” Growth in the individual child’s capability 
to manipulate materials is evidence of success. 

2. There is a great need for ’’concreteness” when working with 
blind children. Use objects that are within the range of the child’s 
experience. Concepts must be recc^nized and understood before 
symbols are used. Items used should be within the ’’touch space” 
of tlie children. 

3. Evaluation should be organized to provide evidence of under- 
standing, not just correct numerical answers. Evaluation should 
lake place during t!ic activity and should be open ended. 

4. Blind children start from ground O and usually they have had 
little prior experience in science. 

5. In the public school situation where the majority of the chil- 
dren are; the ” resource teacher” is available to do the evaluation. 
Therefore, the evaluation can be individualized and open ended. 
Emphasis was placed on the idea of assessment of individual 
accomplishments rather than achievement of an arbitrary standard. 

6. Vocabulary and its meaningful application will be import^! 
in evaluation. Firs’ you will measure the chilcRs ability to use 
lai^uage to describe and explain what happened both verbally and 
in writii^. 

7. Important to realize, you will receive different levels of 
responses at different age and experience levels. Cannot assume 
blind children of a certain age have had usual experiences for 
children of that age. 

8. In first and second grade, no baselines are necessary ZJ you 
can assume the child starts from a lack of experience. From 
then on, experiences and understanding of early (1st and 2nd grade) 
program form the baselines for the upper grade programs. 
Alternately, assess status of child’s experience in science before 
beginning his first unit. Afterwards, post unit measures for 
previous unit form baselines for new unit. Continue to emphasize 
assessment of individual growth. 

9. Baselines for sighted children are not applicable to blind 
children. Blind children tend to be experientially deprived 
children. A blind ^hild starts behind the sighted child of the same 
age, but provided a meaningful program, will show a reasonable 
rate of growth in knowledge and understanding. 
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Summary of the Final Session 

During the final session, many ideas and points of view relative 
to evaluation in this project and evaluation in general were brought 
up. Considerable time was spent discussing the values of, and dif- 
ferences between "behavioristic” and "naturalistic” evaluation. 

In spite of significant differences in approach to evaluation by a 
number of the participants, there were a number of areas in which 
there was agreement relative to the question of evaluation in the 
project. These are: 

1. The evaluation approach needs to be individualized in all ways 
and should attempt to assess the changes in specific pupils. 

2. The evaluation system and approach will have to be original 
since little has been done in the evaluation of the science learnings 
of "blind” children. 

3. Any materials developed will be used ty a group of children with 
very diverse backgrounds and experiences. For these reasons, 
e\Tiluation has to be continuing and related to the individuals in a 
given class or program at a given time. 

4. Children's skill in using tools should be evaluated. An example 
is their abilit 5 ^ to measure a seedling using a brailled ruler. 

5. Considerable emphasis was given to the value of expert observers 
as a means of evaluation of program success. Also such things as 
continued use of the program and parental and other outside opinion, 
were mentioned rts evaluation evidence. 

6. Conce. n was also expressed for finding v/ays to assess the effect 
of the program on the individual's value system and general orienta- 
tion towards science as indicated by his feelings regarding environmental 
pollution and other major problems in society. 

Dr. Carson Y. Nolan, Director, Department of Educational 
Research, American Printing House for the Blind, was a participant 
in tlie cditference and special consultant to the project for two days. 

He made tlie following general comments about the project as a whole, 
luid evaluation in particular during his visit: 

i. He was delighted with the timediness of the project. Usually 
materials for the blind laj.^ developments in the instructional field by 
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a considerable number of years. In this case^ development of the 
adapted prc^ram is taking place during the period of development of 
the regular prc^ram.. 

2. He felt givmg the children first-hand experiences with the ma- 
terials is a very valuable part of the program. He and others felt 
these actual experiences are most important for 'l>lind" children. 

3. During work on the adaptations keep in mind that the market 
is very small numerically and, therefore, the cost of any special 
items which need developing tends to be high. For this reason, 
one should try to use already available (from the regular program 
kits) materials whenever possible. 

4. In relation to evaluation. Dr. Nolan described it as a for midable 
problem of equal magnitude to the curriculum adaptation work. He 
made a plea for keeping the evaluation simple and, as an example, 
suggested simply counting the occurrence of various events in dif- 
ferent categories rather than trying to design complex statistical 
measurements. 



Summary and Conclusions 

The conference proved to be a most valuable experience for the 
members of the project staff. From the discussions emerged the 
feeling that the evaluation plans as described in the attached addendum 
are on the right track, but may represent somewhat more than what 
can be accomplished during the first year. An attitude of tentative - 
ness and willingness to try out alternate approaches is needed. The 
project realizes that in assessing the science learning of young "blind” 
children, they are moving into an area in which little or no previous 
work has been done. 



Report prepared by 
Herbert D. Thier 
with the assistance of 
Carl Berger and 
Robert Knott 
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